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Abstract 

A bounded Kolmogorov-Loveland selection rule is an adaptive strategy for 
recursively selecting a subsequence of an infinite binary sequence; such a sub- 
sequence may be interpreted as the query sequence of a time-bounded Turing 
machine. In this paper we show that if A is an algorithmically random sequence, 
Aq is selected from A via a bounded Kolmogorov-Loveland selection rule, and 
A\ denotes the sequence of nonselected bits of A, then A± is independent of Aq; 
that is, A% is algorithmically random relative to Aq. This result has been used 
by Kautz and Miltersen to show that relative to a random oracle, NP does 
not have p-measure zero (in the sense of Lutz |13j]). 

1 Introduction 

Any plausible characterization of what it means for an infinite sequence to be random 
is likely to incorporate the common notion that one random sequence should not 
contain any information about any other random sequence, or further, that observing 
part of a random sequence should provide no information about any other part of 
the same sequence. These ideas can be found in the intuitive definition of random 
sequences proposed by R. von Mises in the 1920's [21]: what makes a sequence A 
random, he suggested, is that 

(i) limiting frequencies exist, i.e., 

# of l's in A\0..n - 1] 
lim = p 

for some number p (where y4[0..n — 1] denotes the first n bits of A), and 
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(ii) given any admissible rule for selecting a subsequence Aq from A, the limiting 
frequency in A is the same value p. 

The exact meaning of the term "admissible" is problematic and controversial, at 
least in part because there certainly exists a selection rule of the form "select bit A[n] 
iff A[n] = 1." Church [3] proposed limiting the "admissible" rules to be recursive 
functions which given an initial segment v4[0..ri — 1] produce either a zero or one, 
according to whether the nth bit is to be selected. A sequence satisfying (i) and (ii) 
above for every recursive place selection of this form may be called Mises-Church 
stochastic. Such a selection rule corresponds to a gambling strategy for a game in 
which the bits of A are revealed sequentially, such as by successive coin tosses, and 
a gambler has access only to the past history of the game when deciding whether to 
place a bet on the next outcome. The sequence A is Mises-Church stochastic if no 
recursive strategy enables the gambler to alter the expected gain in the long run. It 
is certainly reasonable to accept this as a necessary condition, however, notice that 
the definition fails to include other kinds of strategies (which von Mises clearly had 
in mind) such as "toss a coin, and select bit A[n] if the toss results in heads," which 
intuitively cannot change the gambler's expected gain either. Evidently the crucial 
point is not that the selection process is recursive, but that in some sense it has no 
information about the sequence A; we might say that A must be independent of the 
selection rule. 

The fact that the definition proposed by Church is indeed too weak to satisfactorily 
characterize random sequences is a consequence of a result of Ville (see [22] or |2T|). 
i.e., there are Mises-Church stochastic sequences which fail to satisfy certain widely 
accepted probabilistic laws. Kolmogorov and (independently) Loveland (see [2*T] ) 
offered the generalization of a selection rule given in Definition ^, ll below. No examples 
are known of sequences which satisfy (i) and (ii) for every Kolmogorov-Loveland 
selection rule but which fail to satisfy some "known" probabilistic law ^Hl p. 398], 
though not every such sequence is algorithmically random in the sense of Definition 

oeu, nsi- 

M. van Lambalgen observed that the relation U A is algorithmically random relative 
to B" could be interpreted as an independence relation, and that relative randomness 
in this sense satisfies the axiomatization of independence given in [221 • I n this paper 
we investigate the independence properties of algorithmically random sequences re- 
lated to notions of subsequence selection. We consider two kinds of questions: First, 
if A is algorithmically random and Aq is a subsequence chosen according to a (not 
necessarily recursive) selection rule, what conditions must be imposed on the selec- 
tion rule to guarantee that Aq remains algorithmically random? Second, if A\ denotes 
the subsequence of nonselected bits, for what kinds of selection rules are A and A 1 
independent? 

The main new result proved here is Theorem 14.51 that A and A\ are independent 
when Aq is chosen via a bounded Kolmogorov-Loveland selection rule. While a Mises- 
Church place selection is a special case of a selection rule of this form, the application 
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we have in mind is that the sequence of queries of a time-bounded Turing machine 
may, under certain conditions, be construed as a bounded Kolmogorov-Loveland place 
selection. We indicate, for example, how this fact can be used to prove the well known 
result P that P 7^ NP relative to an algorithmically random oracle. More recently 
Kautz and Miltersen [H] have used Theorem 14.51 to show that relative to a random 
oracle, NP does not have measure zero within the exponential complexity classes 
DTIME(2 linear ) or DTIME(2 polynomial ), an (apparently) stronger separation of P from 
NP. ("Measure zero" refers the resource-bounded measure of Lutz [TB*].) 

2 Preliminaries 

Our notation is for the most part standard. Unfamiliar notions from recursion theory 
can probably be found in Odifreddi [IH] or Rogers [T6] . and everything else we need to 
know can be found in [Zj. Let IN = {0, 1, 2, . . .} denote the natural numbers. A string 
is an element of {0, 1}* or {0, 1, J-}*, where the symbol _L is called an undefined bit. 
The concatenation of strings x and y is denoted xy. For any string x, \x\ denotes the 
length of x, and A is the unique string of length 0. If x G {0, 1, _L}* and j, k G IN with 
< j < k < \x\, x[k] is the kth bit (symbol) of x and x[j..k] is the string consisting of 
the jth through kth bits of x (note that the "first" bit of x is the 0th). For an infinite 
binary sequence A G {0, 1} 00 , the notations A[k] and are defined analogously. 

For any x, y G {0, 1, _L}*, x ^ y means that if x[k] is defined, then y[k] is also defined 
and x[k] = y[k]\ we say that x is an initial segment, or predecessor, of y or that y 
is an extension of x. Likewise for A G {0,1}°°, x C A means x[k] = A[k] whenever 
bit x[k] is defined. Strings x and y are said to be incompatible, or disjoint, if there 
is no string z which is an extension of both x and y; when x,y G {0,1}*, this simply 
means that x%y and y%x. 

Fix a standard enumeration of {0, 1}*, so = A, s\ = 0, S2 = 1, S3 = 00, S4 = 01, . . .. 
A language is a subset of {0, 1}*; a language A will be identified with its characteristic 
sequence xa G {0,1}°°, defined by s y G A xa[u] = 1 for ?/ G IN. We will 
consistently write A for xa- A denotes the bitwise complement of A, i.e., the set- 
theoretic complement of the language A in {0, 1}*. For X C {0, 1} 00 , X c denotes 
the complement of X in {0, 1} 00 . Since the enumeration of strings above provides a 
one-to-one correspondence between strings and natural numbers, we may also regard 
an infinite sequence A subset of IN. 

Typically strings in {0, 1, _L}* will be used to represent partially defined languages 
or partially defined subsets of IN, and will generally be represented by lower-case 
greek letters. For o G {0, 1, _L}*, when no confusion is likely to result we will regard 
a, a _L fc , and a _L°° as essentially the same object, since all specify the same language 
fragment. We avoid using the notation |er| unless a G {0, 1}*, however following 
[TH] we let ||<j|| denote the number of defined bits in a. When a G {0, 1, _L}* and 
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r G {0, 1}*, the notation a [ r ("r inserted into a") is defined by 



(a I t)[x] 



a[x] if a[x] is defined, 

r[j] if x is the jth undefined 

position in a and j < |r], 
_L otherwise. 



For A,Bg {0, 1}°°, A/5 is the subsequence of A selected by B, i.e., if yo, y±, . . . are 
the positions of the 1-bits of B in increasing order, then (A/B)[x\ = A[y x ]. Note that 
A/B is a finite string if B contains only finitely many l's. For cr, r G {0,1}*, er/r 
may be defined analogously. For A, B G {0, 1}°°, the sequence A © B is defined by 



A © 



if x is even, 
B[2±ll if x is odd. 



Let (•,•): IN x IN — > IN be a fixed recursive bijection. Then A^, the column 
of A, is defined by 

AW = {n : (n,i) G A}. 
Given any countable sequence we can define a set 0, whose ith column is Bf. 

®Bi = {{n,i):neBi}. 

i 

Let (fie denote the eth partial recursive (p.r.) function, and ipf the eth p.r. function 
relative to A G {0, 1}°°. We write (f e (x) | if (p e is defined on x, and (f e (x) j otherwise; 
the same holds for the relativized (pf. For s G IN, 

/ \ _ J ¥e{ x ) if V 9 e(^) converges in < s steps 
</?6,s ^ :r ^ j undefined otherwise. 

(p°(x) generally abbreviates ^\ a \{x); we treat (p° or tp ejS as a partially defined set or 
language, i.e., it may be regarded as an element of {0, 1, _L}*. As usual, W e = dom(<^ e ) 
is the eth recursively enumerable (r.e.) set, W ejS = dom({p etS ), = dom(y9^), and 
Wl = dom(y^). 

If (pf is total, so that <pf = B for some set B (i.e., its characteristic function), 
we write B A; if B < T A and A < T B, we write A =t B. A <t B means that 
A< T B but B £ T A. The equivalence class deg(A) = {B G {0, 1}°° : A = T B} is 
called the degree of A; V denotes the collection {deg(A) : A G {0, 1}°°}, the Turing 
degrees or degrees of unsolvability . The relation <t induces a well-defined partial 
order on D (simply denoted <) and the operation © induces a well-defined least 
upper bound operation U on V. The jump of a set A, denoted A', is the set 

{x : <pA(x) |}, 



4 



and represents the nth iterate of the jump of A. For functions / : IN — > IN, by 
deg(/) we mean the degree of the graph of /, {(x, y) : f(x) = y}. 

A string a G {0,1, !_}* defines the subset Ext(a) = {A e {0,1}°° : a □ A} of 
{0, 1}°°, called a cylinder. Ext(cr) is referred to as an interval if a G {0, 1}*; evidently 
any cylinder is a union of intervals. Likewise if S is a subset of {0,1, _L}*, Ext(S') 
denotes LUes Ext(u). If S — W e is an r.e. set of strings, then Ext (5) is called a 
S^-class; the number e is an index of the class. A IT^-class is the complement of a 
S^-class. In general a IT°-class is the complement of a E°-class, and a E° +1 -class is of 
the form (Ji %, where {%} is a uniform sequence of IT°-classes; likewise a n° +1 -class 
is of the form f)i %i where the % are E°-classes. Here, as elsewhere, a uniform (or 
recursive) sequence {%} is one for which there is a recursive function / such that f(i) 
is an index for %; an index for the function / may be called an index of the sequence. 
A class is called arithmetical if it is E° for some n. 

It is also convenient to note that arithmetical classes can be defined in terms of 
quantifier complexity. Let C* be the language of arithmetic with a set constant X 
and a membership symbol G. Then for a sentence <fi of C* and A G {0,1}°°, A \= <fi 
means that (f) is true in the standard model when X is interpreted as A. A E°-class 
is of the form {A : A \= <f)}, where <fi is a E n sentence of £*; likewise for Il°-classes. 
Since notions of computation can be expressed in a simple way in C* we can, for 
example, represent a E°-class in the form 

{A : (3xx)(Vx 2 ) • • • (3x n ){(pf(xi, . . . ,x n ) I]} 

if n is odd, and in the form 

{A : (3xx)(Vx 2 ) • • • (yx n )[ipf(x 1 , . . . ,x n ) |]} 

if n is even. See Rogers ^J] for details. 

The definitions of arithmetical classes can all be relativized; e.g., a Ef -class is of 
the form Ext(W / e c ), etc. Note, for example, that a T,f" 1} -class is an open E°-class, 
and a n° " 1) -class is a closed LT^-class, where we take {Ext (cr) : a G {0, 1}*} as the 
base of a topology on {0, 1}°°. 

By a measure we simply mean a probability distribution on {0, 1}°°, and for our 
present purposes it is sufficient to consider the uniform distribution, i.e., each bit is 
equally likely to be a zero or a one, also called Lebesgue measure. The measure of a 
subset £ of {0, 1}°°, denoted Pr(£), can be intuitively interpreted as the probability 
that a sequence produced by tossing a fair coin is in the set 8; in particular the measure 
of an interval Ext(cr), abbreviated Pr(er), is just (or if a G {0, 1,-L}*). 

For S a set of strings, we abbreviate Pr(Ext(5)) by Pr(5); if S is disjoint, i.e., all 
strings in S are pairwise incompatible, then 

Pr(S0 = £Pr(<7). 
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Standard results of measure theory (see show that £ is measurable (meaning that 
Pr(£) is defined) as long as 8 is a Borel set, i.e., built up from intervals by some 
finite iteration of countable union and complementation operations; in particular 
arithmetical classes are always measurable. 

3 Effective Approximations in Measure 

Equivalent definitions of algorithmic randomness have been given by Martin-L6f |14j . 
Levin [T2], Schnorr [17], Chaitin [3 El EI, and Solovay [T^j, and generalizations and 
closely related variations have been given by Kurtz [TI], Kautz [H], and Lutz [T^]. Here 
we present the definition due to Martin-Lof and the generalization (n-randomness) 
first investigated in [11]. The idea is to characterize a random sequence by describing 
the properties of "nonrandomness" which it must avoid. For example, we might 
examine successively longer initial segments a of a sequence A e {0, 1}°° and discover 
that 

# of ones in a ^ 3 , . 

H ~ 4' 

We would then suspect that A is not a sequence we would normally think of as random. 
A "test" for this particular nonrandomness property can be viewed as a recursive 
enumeration of strings a for which (JTJ) holds; if A has arbitrarily long initial segments 
satisfying ((TJ, we reject A as nonrandom. Now among all possible enumerations 
of strings, how do we decide a priori which ones characterize a "nonrandomness" 
property? Since ultimately we expect the nonrandom sequences to form a class with 
measure zero, we can require that as we enumerate longer initial segments in the 
"test", the total measure of their extensions should become arbitrarily small. The 
mathematical content of this discussion is made precise in following definition. 

Definition 3.1 A Martin-Lof test is a recursive sequence of £?-classes {Si} with 
Pr(<Sj) < 2~\ A sequence A e {0, 1}°° is 1-random if for every Martin-Lof test {Si}, 

The requirement that a test consist of recursively enumerable sets of strings is 
a natural starting point but is admittedly somewhat arbitrary. A generalized form, 
where S°-classes replace E^-classes, first appeared in Kurtz [TTj. We will also find it 
useful to define randomness relative to an oracle. 

Definition 3.2 Let A, C G {0, 1}°°. A is approximate, or approximable in E^- 
measure, if there is a recursive sequence of S^-classes {Si} with Pr(iSj) < 2~* and 
A ef)i Si. The sequence {Si} is called a -approximation , or if n — 1, a Martin-Lof 
test or constructive null cover relative to C. A is C -n-random , or n-random relative 
to C, if A is not S^-approximable. If C is recursive then A is n-random. We also say 
A is uj-random if A is n-random for all n. 
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The definition of n-randomness as given above is difficult to work with directly 
when n > 1, and there are two basic tools which simplify our work considerably. 
The first is Lemma 13.51 below, which asserts that n-randomness is the same as 1- 
randomness relative to O*-™ -1 ^, or more generally, that (m + n)-randomness relative to 
an oracle C is the same as n-randomness relative to C^ m \ The second is Theorem 
13.81 which shows that if A is (n + l)-random, then A © 0^ n \ These two facts 

allow many results on 1-randomness to be straightforwardly generalized. 

The proof of Lemma 13.51 depends on the idea that an approximation in measure 
can be replaced by an approximation using open classes of the same arithmetical 
complexity. Lemma 13.41 extends Kurtz' Lemma 2.2a (fTJ p. 21]) with a number of 
technical refinements which will be needed later. 

Lemma 3.3 The predicate 'Pr(iS) > e" is uniformly where S is a -class and 
e is rational. Likewise "Pr(«S) < e" is uniformly E^ 7 when S is a U^-class. 

Proof. See Kurtz [TTj. • 

Lemma 3.4 (i) For S a -class and e > a rational, we can uniformly and 
recursively obtain the index of a 1} -class (an open H^-class) U D S with 
Pr(W) - Pr(5) < e. 

(ii) For T a 11^ -class and e > a rational, we can uniformly and recursively obtain 
the index of a nf ( ™ 11 -class (a closed IL^ -class) V C T with Pr(T) — Pr(V) < e. 

(Hi) For S a T^-class and e > a rational, we can uniformly in C^ n ' obtain a closed 
U^-class VCS with Pr(«S)-Pr(V) < e. (Ifn >2,V will be a nf ( "" 2) -class.) 
Moreover, z/Pr(«S) is a real recursive in C^ 1 ^, the index for V can be found 
recursively in C ( - n ~ 1 ^. 

(iv) For T a IL^ -class and e > a rational, we can uniformly in C^ n > obtain an open 
E^-class U DT with Pr(ZY) - Pr(T) < e. (Ifn >2,U will be a sf"" 2> - 
class.) Moreover, i/Pr(T) is a real recursive in C^ n_1 \ the index for hi can be 
found recursively in C ,( - n ~ 1 ^. 

Proof. • 

The characterization in terms of approximation by open sets now follows easily 
from Lemma [3.41 

Lemma 3.5 Let A,C E {0, 1}°°, n > 1, and m > 0. Then A is S^ (m -approximable 
-<=>- A is S^ +n - approximable. 
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Proof. (=>) Immediate, since any E^ 7 m -class is a E^ +n -class. 
(<^=) We show that a E^ +1 -approximation can be replaced by a Ef <m) -approximation; 
the result will then follow by induction on n. Let C G {0, 1}°° and m > 1 be arbitrary. 
Suppose {Si} is a E^ +1 -approximation. By Lemma frS.4f i) we can uniformly find for 
each i a Ef (m) -class U { D S { with Pr(W,) - Pr(S<) < 2~\ Thus Pr(W i+ i) < 2~\ so 
is a Ef (m) -approximation and flj^i Q C\i^i+i- • 

We conclude this section by stating several results we will need which have been 
known for 1-randomness, and which can be easily generalized using Lemma f3. 51 The 
first of these is known as the "Universal Martin-L6f Test". For a proof see ^3] or [Hj. 

Theorem 3.6 (Martin-L6f) For any C G {0, 1}°° and any n > 1 there exists a 
universal E^- approximation. That is, there is a recursive sequence o/Ef ( ™ 1 -classes 
{Ui\, with Pr(Wj) < 2~ % , such that every approximate set is in flj^. 

The next result is a characterization of n-randomness due to Solovay. It shows 
that the conditions "Pr(«Sj) < 2~ 4 " and Ll A G Cli.Si" in definition 13 . 21 are both stronger 
than necessary. A proof can be found in j2] or [H]. 

Theorem 3.7 (Solovay) Let A, C G {0, 1}°° and n > 1. A is C -n-random <^=^ for 
every recursive sequence of Yf^- classes {Si} with J2iP r (<Si) < °°; A is in only finitely 
many Si. 

We close this section with one of the single most useful facts about n-randomness, 
since it allows many results about E^-approximations to be extended to E°-approx- 
imations. It strengthens a result originally due to Sacks that the class {A : A' =t 
A (BO'} has measure one (2D]- The proof is in |Hj. 

Theorem 3.8 For n > ; if A is (n + l)-random, then A^ n > =t A © O' 71 '. 

4 Independence and place selections 

The definition below describes a very general selection process which encompasses 
several special cases of interest. The process may be pictured as follows, as suggested 
in |2*T| : Suppose the sequence A is represented as a row of cards laid face down; on 
the face of the ith card is either a zero or a one, corresponding to A[i]. We have two 
functions, F and G, which are used to select some of the cards to create a second 
sequence, which we continue to call a "subsequence" even though the order of the 
cards may be changed. Both F and G look at the history of the selection process, 
that is, the sequence of cards turned over so far. The value of F is a natural number 
indicating the position of the next card to be turned over. The value of G is either 
or 1; if the value is 0, the card is merely turned over and observed, while if the value 
is 1 the card is also selected, i.e., added onto the end of the subsequence. 
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Definition 4.1 A Kolmogorov-Loveland place selection 21 is a pair of partial re- 
cursive functions F : {0, 1}* — > IN and G : {0, 1}* — > {0, 1} (possibly relative to an 
oracle C). Let A e {0, 1}°°; -F and G select a subsequence Q* from A as follows. First 
define sequences of strings ^ E 6 E • • • and po E Pi E • • • such that £o = Po = A, 
£j+x = £jA[F(£j)], and p J+ i = PjG(£j) (with the proviso that is undefined if 
F(£j) = F(£i) for some i < j or if either F or G fails to converge). If £j and p^ are 
defined for all j let Q = linx, and R = linx,- py. Thus Q represents the sequence of 
all bits of A examined by F, in the order examined. A given bit Q[j] = A[F(£j)] is 
included in the subsequence Q* just if G(£j) = 1, i.e. F determines which bits of A 
to examine, and G determines which ones to include in the sequence Q* . Formally 
we define Q* = Q / R. A Kolmogorov-Loveland place selection will be called bounded 
if the function G is determined by a partial recursive function H : {0, 1}* — ► IN 
(possibly relative to oracle C) with the following properties: 

(i) H is nondecreasing, i.e., if £ □ £' then H(£) < H(£'), 

(ii) H is unbounded, i.e., if £j and pj are defined for all j then linx,- H(£j) = oo, and 

(iii) G is determined by H according to the rule 

F(0<H(0 =► G(O = 

It is also useful to define a sequence -B by B[z] = 1 if and only if for some j, F(£j) = z 
and G(£j) = 1, so that N = A/B consists of the "nonselected" bits of A, in their 
natural order. 

If it is always the case that F(£) — n, where n — then we have a Mises-Church 
place selection. Note that if in addition G(£) depends only on the length of £, then 
the selected subsequence is of the form A/B, for a fixed sequence B. 

In general it is not difficult to show that a subsequence selected from an n-random 
sequence is also n-random. 

Theorem 4.2 Let A,B,C G {0, 1}°°; suppose F and G are partial recursive in B 
and determine a K-L place selection. If A is algorithmically random relative to B@C , 
then Q* is algorithmically random relative to C . 

Sketch of proof: Suppose {Ui} is a Ef -approximation of Q*; we can construct a 
Ef ffiC, -approximation {Si} of A. Let Ui = Ext(W / e B ). For a enumerated in Wf, start 
with a string a =_L°°. simulate F and G: If G(£) = 1, let a[F(£)] = next bit of a. 
If G{£) = 0, then split into two strings, let a [F(£)] = and a d F (0] = 1 - When 
no more bits of a are available, enumerate the corresponding string a into Total 
measure of all strings a associated with a is not more than Pr(cr), since each time 
we split into two strings an additional bit of a is defined. • 
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Note that it follows, using Lemma 13.51 and Theorem 13.81 and taking C = ( - n_1 \ 
that if A is n-random relative to B, then Q* is n-random. We can also conclude that 
if A is n-random relative to B (and B is infinite) then A/B is n-random. Note in 
particular that, as predicted by von Mises' intuition, the place selection function, or 
the sequence B, does not have to be recursive. In fact, it is a consequence of the 
following result that if A is n-random, then almost every place selection preserves the 
randomness properties of A. 

Theorem 4.3 Let A,C E {0,1}°°. If {B : A is Ef ffiC approximate] has positive 
measure, then A is Ef -approximate. 

It then follows, that if A is n-random, 

{B : A is n-random relative to B} (2) 

has measure one: note that by Lemma [3.51 and Theorem 13 .8[ A is Ef -approximable 
iff it is Ef '"^ -approximable, and = T B © O^" 1 ). Hence if the set © has 

measure < 1, then {B : A is Ef 00 " ^-approximable} has positive measure, which 
would imply that A is E° " ^-approximable, i.e., not n-random. 

Proving that a selected subsequence is actually independent of the nonselected 
bits is quite a bit more subtle. We begin with the relatively straightforward version 
below. Although it is actually a consequence of Theorem I4.5| the idea of the proof is 
much more in evidence in this simpler setting. 

Theorem 4.4 Let A,B,C G {0, 1}°°. If A® B is 1-random relative to C, then A is 
1-random relative to B © C . 

Proof. As the relativization is straightforward we will suppress the oracle C for 
readability. We show that if A is Ef -approximable, then A © B is E^-approximable. 
Suppose A is Ef -approximable, say by {%}. Let / be a recursive function giving the 
indices of the classes %, i.e., % = Ext{W^). Fix i and let e = f(i). We describe 
a uniform procedure for enumerating a set of strings Si such that {Ext(Sj)} is a 
E^-approximation of A © B. Let Si )S be the set of strings 

{a © T : \a\ = |r| = s & (3a' C a)(3r' C r)[a' G W^' & Pr(Ext(W e T ')) < 2 _i ]} 

and Si = Us Si,s- Note that Si is r.e. Certainly A © B is in Ext (Si), since some initial 
segment a' of A is in Wf and hence in WJ" for some r C B with s = |r| > \a'\. Thus 
a © r is enumerated in Sj. s , where a is the initial segment of A of length s. 

To show that Pr(Ext(Sj)) < 2~\ since Ext(Sj iS ) C Ext(Sj jS+1 ) it will suffice to 
show that for each s, Pr(Ext (Si jg )) < 2~\ Fix s and fix a string r of length s. Let 
r* be the longest initial segment of r such that Pr(Ext(W / e T *)) < 2~\ Then for every 
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string of the form a © r in Si )S there must be some a' C a in H^ 7 "* , so the measure 
contributed to S itS by strings of the form a © r cannot exceed 

= 2~ |r| •Pr(Ext(W e r *)) 
< 2~ s ■ 2~* 

(where we have tacitly assumed that Wl* is disjoint). There are 2 s strings r of length 
s, so the total measure of Ext(Si. s ) is at most 2 _i . • 

It follows that if A © B is n-random, then A is n-random relative to B. If A 
is X^-approximable, then A is Sf " ^-approximable (by Lemma I3.5)) . and hence is 
Ef®° ( " ^-approximable by Theorem 13.81 (note that B is n-random by Theorem I4.2J1 . 
Thus A © B is " 1 -approximable by Theorem 14.41 i.e.. not n-random. 

A converse has been proved by van Lambalgen [22]: if B is n-random and A 
is n-random relative to B, then A © B is n-random; then it follows that -B is also 
n-random relative to A. 

The result below encompasses Theorem 14.41 as well as a number of other cases of 
interest, such as Mises-Church place selections and selections of the form A/B for a 
fixed B. The remainder of this section will be devoted to a proof of the result. 

Theorem 4.5 Let A,B,C G {0,1}°°. Let F and H be partial recursive functions 
relative to B which determine a bounded Kolmogorov-Loveland place selection, and 
let N and Q* be as in Definition ^. 1\ If A is algorithmically random relative to B®C 
and N is infinite, then N is algorithmically random relative to Q* © C . 

Notice that using Lemma 13.51 and Theorem 13.81 and taking C = CK" -1 ) and B 
recursive, it follows from Theorem 14.51 that if A is n-random then iV is n-random 
relative to Q*. Moreover, by the converse to Theorem 14.41 noted above, it follows that 
Q* is also n-random relative to N. 

Before beginning the proof, we isolate a counting argument that will be needed. 

Lemma 4.6 Let s G IN and let f be a real-valued function on {0, 1}* whose domain 
includes all strings of length at most s. Suppose there is a constant c such that for 
every string Tq of length s, 

Then 

± J2 2- |r| /(r) < c. 

3=0 \r\=j 

That is, the domain of f can be viewed as a full binary tree of height s with a real 
value assigned to each node; if the sum along each branch is bounded by c, then the 
sum, for j < s, of the average value of the nodes at level j is also bounded by c. 
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Proof. First note that if M is any nx m real matrix and c is a constant such that 
the sum of each column is bounded by c, then the total of the averages of the rows is 
bounded by c. This is easy to see, since if 

n-l 

J2M(j,k)<c 

for each k = 0, . . . , m — 1, then 

n— 1 / i 171 — 1 \ i m-ln-1 i m— 1 

E - E M U fc ) =-EE M U *0 < - E c = c - (3) 

Let m = 2 s and n = s + 1 and let r , ri, . . . , r m _! be a list of all strings of length s. 
Define an n x m matrix M by 



M(j,k) 



f(r k [0..j-l}) ifj>0 
/(A) if J = 



That is, the values along the branch correspond to the kth column of M, so the 
sums of the columns of M are bounded by c. For each j = 0, . . . ,n — 1, the values in 
row j are of the form /(r) for strings r of length j; there are 2 J possible values /(r), 
each of which must occur 2 s- - 7 times in row j. Hence 



m—l 



k=0 \r\=j 



and so 



n-l 



EE 2 %) = EE2- J /(r) 

i=°kl=i i=° |T]=j 



n— 1 i 

E E ^2-V(r) 

j=0 | T ]=j Z 
n— 1 i m—l 

E E m k) 

j=0 Z k=0 



< C 



by ©. 



Proof of Theorem \4 ■ 5\ Suppose that {[/j} is a constructive null cover relative to Q* 
with iV G Hi Ext(J7i) . We suppress the oracle C. We will exhibit a constructive null 
cover {Si} (relative to B) of A by describing a procedure for enumerating, uniformly 
in B, a set Si such that A G Ext(Sj) and Pr(Sj) < 2 _ *. Fix i; we can uniformly 
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obtain an index e for which [/< = W®* . Let e be fixed throughout the remainder of 
the proof. 

The enumeration of Si may be loosely described in the following way: we "guess" 
an initial segment r □ Q* and enumerate strings o G WJ t for t = 0, 1, . . . , |r| as 
long as Pr(WJ t ) < 2~ l . For each pair (er, r) we attempt to "reconstruct" an initial 
segment a C A That is, we attempt to construct a string a e {0, 1, _L}* such that 
when the place selection is applied to a (stopping when F attempts to examine an 
undefined bit), the selected subsequence is exactly r and the nonselected subsequence 
is exactly er. Si then consists of an enumeration of all the strings a obtained for all 
possible "guesses" r. 

We give below a formal definition of a partial recursive function 

S:{0,1}*x{0,1}*^{0,1,±}* 

which produces a from an input pair (a, r). The construction of S can be informally 
described as follows: During the course of the construction, we define sequences 
Co E Ci E • • • and ao E «i E • • • of strings. S will be attempting to simulate the 
action of F and H on the sequence A, and each string represents what S believes 
to be the corresponding actual value of the string of Definition 14.11 The strings cVj 
represent approximations to A. The idea is that S will regard r as an initial segment 
of Q* and a as an initial segment of N; as S reads through r it uses the value of 
to determine the original position that each of the selected bits originally had 
in A, and in effect what S does is replace each bit of r in its proper position in aa- To 
simulate the action that F and H would have taken on A, S needs the correct value 
of the bit examined by F at each step. There are only two possibilities at any stage 
i in the simulation: if F(£i) > Hfe), the correct value should be the next bit of r. If 
F(£i) < H(£i), the positions in cvj to the left of H^i) which have not yet been defined 
using bits from r must correspond to bits of N, so they can be filled in with the initial 
part of er and the correct value of A can be determined from «j j, er. Obviously if 
t ^ Q* or a ^ N, the simulation will be incorrect and if S(a, r) converges to some 
value a, it is unlikely that a C A. The fact that we only consider pairs (er, r) for 
which er e W^ t and Y > r(W^ t ) < 2~* will be used to ensure that Pr(S , i ) < 2~\ 
Construction of S: At stage 0, let 

e* =J-°°, £ = A, and t = 0, 

where ti is a marker indicating the next unexamined bit of r. 

At stage k + 1, let h = H(£k) and let u be the number of undefined bits in 
ak[0..h — 1]. If |er| < u, then the construction diverges and S(a,r) is undefined. If 
|er| > u let a* k = otu { cr[0..M — 1]. If |cr| = u and |r| = t k , then the construction 
terminates at stage k + 1 with value 

S{ct,t) = a* k . 

Otherwise one of the following cases applies: 
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Case 1: Ffa) < h. Then let 



tk+l 

and a k+ i 



£k<*t[F(t k )] 




and for all z G IN, a k+1 [z] = I T fy\ 

{ OL k [z\ 




The crucial properties of the function S are summarized in the claim below. The 
proof of Claim 14.71 is technical, and we will postpone giving the details until the end 
of this section. 



(i) If S(ct,t) converges with value a and S(a',r') converges with value a', then 
a' C a and r' C r imply that a' C a. 

(ii) If S(o~,t) converges and a' is a proper initial segment of a, there is no proper 
extension r' of r for which S(o~', r') converges. 

(Hi) If S(a,r) converges with value a, then Pr(a) = 2~' CT H T l 

(iv) If r C Q* and o~ \Z N and S(a,r) converges with value a, then a C A. 

(v) For any strings r' □ Q* and a' C N, there exist a, r G {0,1}* sitcA £/iat 
r' C r C Q*, a' C cr jZ iV ; and S(o~, r) converges. 

We next show how to obtain a constructive null cover {S^} of A, given the prop- 
erties listed above of the function S. First define a recursive function t by 



Claim 4.7 Let A, Q* , and N be as in Definition \4.1\ 



t(r) = max{r < \r\ : Pr(W£ r ) < 2~ 4 }. 



Then for s G IN and r G {0, 1}*, let 



r) : For some a' □ <r, <r' G W^j} 

U -V 



r|<s 



U 5 ^ 



s 



We need to verify the following two facts. 
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Claim 4.8 A E Ext(Si). 



Proof of Claim Since by assumption N E Ext(C/j), there is an initial segment 
a' C N with a' E Wf. It follows that for some r' C Q*, a' G Wj^j. By Claim 
I4.7f iv) and (v), there are strings a, r such that o' C a □ iV, r' □ r □ Q*, and 
S(a,r) = a C A. Since Pr(W e Vi) < Pr(£/j) < 2~ J , it follows that a is enumerated 
into Si iT and hence into S^. • 

Claim 4.9 Pr(S r i ) < 2 

Proof of Claim \4~@[ Since it is clear that 5*j. s C Si jS +i for all s, it suffices to fix s 
and show that Pr(5j. s ) < 2"\ For each r, |r| < s, define a set 

B{t) = {cr : S(a, r) converges and some a' C cr is in W 7 "^, s}. 

Note that Si )T = {5* (a, r) : cr G -B(r)} and that 

Si,s = {S(o~, t) : \t\ < s and a E B(r)}. 

Define a string a E B(t) to be an initial string if there is no proper prefix a' C cr 
such that cr' G B(t') for some r' C r. Let B*(r) denote the initial strings in B(t). 

Consider a string r, |r| < s. If cr G -B(r), there is a unique shortest predecessor 
a' C a such that S(<j',t') converges for some r ; comparable to r. By Claim l4~7T ii). 
we may assume that r' □ r. It follows that cr' is an initial string, and if a' ^ o then 
cr is not an initial string. Then \J{B*(r') : r' jZ r} is prefixfree, and so 

E P'(SV)) = Pr ((J^V) : ^ E r}) < Pr(^ (T) ) < 2"*. (4) 



t'Lt 



It further follows from Claim l4~?T i) that 

Ext{S(cr,r) : |r| < s and a E B(t)} = Exk{S(<r,r) : |r| < s and a G B*(r)}. 



Then 



Pr(S M ) = Pr{5(cr,r): |r| < s and c G B*(r)} 
< £ Pr(5(a,T)) 



t|<s 

<t<=B*(t) 



E 2- |CTh|r| by Claim \Fflm) 



\t\<8 



= J2 E 2- |r| Pr(fi*(r)) 

i=0 |r|=j 

< 2"\ 

where the last inequality follows from (|4"J). using Lemma [4.61 with /(r) = Pr(5*(r)). 
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All that remains is to verify the properties listed in Claim 14.71 
Proof of Claim \4- 7\ Parts (i) and (ii) are straightforward consequences of the 
fact that in the construction of S, the inputs are used from left to right. Suppose 
S(o~, r) converges to a at stage k + 1, and let ak, and tk be the final values of 
the variables in the construction; suppose also that S(a', r') converges to a 1 at stage 
j + 1 and let aj, and tj be the corresponding final values. Let hj = H(£j) and 
hk = H(£k)- Suppose a' C cr and r' jZ r. Since the inputs are used from left to right, 
the construction of S(o, r) is identical to that of S(a', r') up to the stage at which 
the latter converges, i.e., a, |Z ak and £j |Z Since if is nondecreasing, and no bits 
of aj to the left of hj can be defined after stage j + 1 in the construction, we know 
Qjj[0../ij — 1] = ak[0..hj — 1]. Since the number of undefined bits in aj[0..hj — 1] is 
exactly \a'\ (by the definition of the convergence of S), we have 

a' = (aj | a') C (a fc | cr) = a, 

which establishes (i). 

For (ii), we use the notation of the preceding paragraph, and assume that a 1 is a 
proper initial segment of a and that r C r' . Again the construction of S(o~, r) must be 
identical to that of S(a', r') up to the stage at which one of them converges. Suppose 
that S(a',T') converges first, i.e., that k < j. Then a fc jZ aj, ^ C £j, hk < hj, and 
ak[0..h k — 1] = aj[0..hk — 1], implying that 

| cr | = # of undefined bits in aj.[0..hk — 1] 
> # of undefined bits in aj[0..hj — 1] 

= Wl 

contradicting the fact that a' is a proper initial segment of a. Therefore j < k, and 
so tj < tk and \r'\ < |r|, i.e., r' cannot be a proper extension of r. 

For part (iii), note that when the computation S(a, r) converges at a stage k + 1, 
exactly |r| bits of have been defined, so the value a = ak { o~ has exactly \t\ + \<j\ 
defined bits. 

Parts (iv) and (v) involve slightly more work. We first prove inductively that 
the following conditions (a)-(e) hold. Suppose that cr jZ iV and tCQ* and S(a, r) 
converges. Then (using the notation of Definition I4.1J1 at each nonterminating stage 
k in the computation of S(a, r), 

(a) \£k/Pk\ = tk, 

(b) 4 = 

(c) a fc C A 

(d) for all z < H(£ k ), &k[z] is defined <^=^> B[z\ = 1, and 

(e) a* k C A. 
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Base step: When k = 0, (a), (b), and (c) are immediate. For (d), note that no 
bit of A to the left of H(X) is ever selected, so B[z] = for z < H(X); also a [z] is 
undefined for all z. For (e), let h = H(X); since ao is undefined at all bits, 

a* = ( ao I a [0..h - 1]) = a[0..h - 1] = N[0..h - 1] = A[0..h - 1], 

where the last equality follows from the fact that B[z] =0 for all z < h. 

Induction step. Suppose (a)-(e) hold for j < k. For (a), (b), and (c) there are 
two cases: 

Case 1: F(£ k ) < H(£ k ). 

(a) By construction t k = t k+ i, and since = ^ by the induction hypothesis, 
F(£ k ) < H(£ k ) and so p k + 1 = p k 0. Hence 

\£k+i/ Pk+i\ — \£k/Pk\ —t k — tk+i- 

(b) By the induction hypothesis, a k C A and £ k = £ k ; in view of the latter it 
is enough to show that the {k + l)st bits of £ k +i and ^ k+ \ are equal: 

£ k+1 [k] = at[F{£ k )} = A[F(£ k )] = 

(c) By construction a k+ i = a k C A. 
Case 2: F(£ k ) > H(£ k ). 

(a) By construction t k = t k + 1, and since £ k = £ k by the induction hypothesis, 
F{€k) > H{£ k ), so p k + 1 = p k l; hence 

|^fc+l/Pfc+l| = \£,k/ Pk\ + 1 — t k + 1 — t k+ i. 

(b) Again £ fc = £ fc by the induction hypothesis, and since 6c+i/ Pk+i E r E Q*, 

fft+ifc] = 7"[t fc ] = (C*+i/p*+i)[tfc] = (5) 

(c) We have at C yl by the induction hypothesis, and by construction 
a k+ i[z\ = a k [z] for all z ^ F(£ k ). By © above, r[£ fe ] = £ k+1 [k], which 
is equal to A[F (£&)]. Then 

<Xk+i[F(i k )] = r[t k ] = A[F(^ k )} = A[F(£ k )}, 

so a k+1 C A. 
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For (d), suppose that z < H(£k + i). Note that H(£k+i) = H(£k+i) by (b) above. 
Then 

is defined -<=>- for some j < k, z = F(£j) > H(£j) 
-<=>- for some j < k, z = F(£j) > H(£j) 
^ B[z] = l. 

Part (e) follows from (c) and (d): Let h = H(£k+i), ft = B[0..h — 1], and let u 
denote the number of undefined bits in ak+i[0..h — 1]. Then 

a t+i/ft = a k+i/ft by (d) 

= A/ ft by (c), 

so a* k+1 / ft = a[0..u — 1] 

= A/ ft since a C N = A/B. 

But a* k+1 /ft = A/ ft and a* k+1 /ft = A/ ft imply that a* k+1 [0..h - 1] = A[0..h - 1]. 
Since c4 +1 [z] = a^+ifz] for all z > h, we have o4 +1 C A by (c). This completes the 
induction. 

Now Claim l4~7T iv) follows from part (e), since when S(a, t) converges at a stage 
k + 1, the final value is a = a* k C A. 

The final step is to verify part (v) of Claim 14.71 Consider any integer k for which 
Ffa) > Hfa). Let h = #(&), and let 

t = ik/pk (6) 

and a = A[0..h-1)/B. (7) 

Clearly rCQ* and uCjV. It is also the case that S(a, r) converges: at stage k + 1 
in the construction, we have = \£k/Pk\ = \ T \ by part (a), h = H(^ k ) = H(^ k ) by 
(b), and by (d), 

# of undefined bits in afe[0../i — 1] = # of zeros in B[0..h — 1] 

= M by©, 

so 5(a, r) converges. Since Q* and N are assumed to be infinite, it is always possible 
to find a k such that F(^ k ) > H(^ k ) and such that the strings r and o of © and 
(J7J) are as long as desired; therefore a and r can be found which extend any given 
t' C Q* and a' C AT. 

The proof of Claim 14.71 and hence the proof of Theorem 14.51 is now complete. 
Thank you for your support. • 
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